Framework-based qualitative analysis of free responses of Large Language Models: Algorithmic fidelity.

Today, with the advent of Large-scale generative Language Models (LLMs) it is now possible to simulate free responses to interview questions such as those traditionally analyzed using qualitative research methods. Qualitative methodology encompasses a broad family of techniques involving manual analysis of open-ended interviews or conversations conducted freely in natural language. Here we consider whether artificial "silicon participants" generated by LLMs may be productively studied using qualitative analysis methods in such a way as to generate insights that could generalize to real human populations. The key concept in our analysis is algorithmic fidelity, a validity concept capturing the degree to which LLM-generated outputs mirror human sub-populations' beliefs and attitudes. By definition, high algorithmic fidelity suggests that latent beliefs elicited from LLMs may generalize to real humans, whereas low algorithmic fidelity renders such research invalid. Here we used an LLM to generate interviews with "silicon participants" matching specific demographic characteristics one-for-one with a set of human participants. Using framework-based qualitative analysis, we showed the key themes obtained from both human and silicon participants were strikingly similar. However, when we analyzed the structure and tone of the interviews we found even more striking differences. We also found evidence of a hyper-accuracy distortion. We conclude that the LLM we tested (GPT-3.5) does not have sufficient algorithmic fidelity to expect in silico research on it to generalize to real human populations. However, rapid advances in artificial intelligence raise the possibility that algorithmic fidelity may improve in the future. Thus we stress the need to establish epistemic norms now around how to assess the validity of LLM-based qualitative research, especially concerning the need to ensure the representation of heterogeneous lived experiences.

Informing behaviour change intervention design using systematic review with Bayesian meta-analysis: physical activity in heart failure.

Embracing the Bayesian approach, we aimed to synthesise evidence regarding barriers and enablers to physical activity in adults with heart failure (HF) to inform behaviour change intervention. This approach helps estimate and quantify the uncertainty in the evidence and facilitates the synthesis of qualitative and quantitative studies. Qualitative evidence was annotated using the Theoretical Domains Framework and represented as a prior distribution using an expert elicitation task. The maximum a posteriori probability (MAP) for the probability distribution for the log OR was used to estimate the relationship between physical activity and each determinant according to qualitative, quantitative, and qualitative and quantitative evidence combined. The probability distribution dispersion (SD) was used to evaluate uncertainty in the evidence. Three qualitative and 16 quantitative studies were included (N = 2739). High pro-b-type natriuretic peptide (MAP = -1.16; 95%CrI: [-1.21; -1.11]) and self-reported symptoms (MAP = - 0.48; 95%CrI: [ -0.40; -0.55]) were suggested as barriers to physical activity with low uncertainty (SD = 0.18 and 0.19, respectively). Modifiable barriers were symptom distress (MAP = -0.46; 95%CrI: [-0.68; -0.24], SD = 0.36), and negative attitude (MAP = -0.40; 95%CrI: [-0.49; -0.31], SD = 0.26). Modifiable enablers were social support (MAP = 0.56; 95%CrI: [0.48; 0.63], SD = 0.26), self-efficacy (MAP = 0.43; 95%CrI: [0.32; 0.54], SD = 0.37), positive physical activity attitude (MAP = 0.92; 95%CrI: [0.77; 1.06], SD = 0.36).

Psychosocial Risk Factors for Health-Related Quality of Life in Adult Congenital Heart Disease.

BACKGROUND: There is variability in the impact of adult congenital heart disease (ACHD) on health-related quality of life (HRQoL). A greater insight into the impact of ACHD may be gained from investigating HRQoL in various diagnostic groups and considering the importance of psychosocial risk factors for poor HRQoL. OBJECTIVE: We compared the HRQoL of people with ACHD with normative data from the general population and among 4 diagnostic groups and identified risk factors for poor HRQoL in ACHD from a comprehensive set of sociodemographic, clinical, and psychosocial factors. METHODS: We conducted a cross-sectional study with 303 participants from 4 diagnostic groups Simple, Tetralogy of Fallot, Transposition of the Great Arteries, Single Ventricle who completed measures of illness perceptions, coping, social support, mood, and generic and disease-specific HRQoL. Data were analyzed using 1-sample t tests, analysis of variance, and hierarchical multiple regressions. RESULTS: There was diminished psychosocial HRQoL in the Simple group compared with the general population. Consistently significant risk factors for poor HRQoL included younger age, a perception of more severe symptoms due to ACHD, depression, and anxiety. Clinical factors were poor predictors of HRQoL. CONCLUSIONS: The findings highlight the need to develop intervention studies aiming to improve HRQoL in people with ACHD and the routine assessment of illness perceptions and mood problems during key periods in people's lives. This will help address patient misconceptions that could be tackled by clinicians or specialist nurses during routine outpatient appointments and identify people in need of psychological support.

Beyond the physical risk: Psychosocial impact and coping in healthcare professionals during the COVID-19 pandemic.

AIMS AND OBJECTIVES: This study aimed to examine the psychosocial impact and identify risk factors for poor psychosocial outcomes in healthcare professionals during the Coronavirus disease 2019 (COVID-19) pandemic in Cyprus. BACKGROUND: Healthcare professionals are in the forefront of the COVID-19 pandemic facing an unprecedented global health crisis, which can have consequences on their psychosocial health. There is a need to identify risk factors for poor psychosocial outcomes to inform the design of tailored psychological interventions. DESIGN: Cross-sectional online study. METHODS: A total of 1071 healthcare professionals completed self-report questionnaires. Measures included sociodemographic information, COVID-19-related characteristics, quality of life (Brief World Health Organization Quality of Life; WHOQOL-Bref), anxiety (Generalized Anxiety Disorder-7; GAD-7), depression (Patient Health Questionnaire-8; PHQ-8), occupational burnout (Copenhagen Burnout Inventory; CBI), and coping (Brief Coping Orientation to Problems Experienced; Brief COPE). This article follows the STROBE reporting guidelines. RESULTS: The prevalence of moderate to severe anxiety and clinically significant depression was 27.6% and 26.8%, respectively. Significant risk factors for poor psychological outcomes included being female, being a nurse or doctor (vs non-medical professional), working in frontline units (inpatient, intensive care), perceptions of inadequate workplace preparation to deal with the pandemic, and using avoidance coping. Depression and occupational burnout were significant risk factors for poor quality of life. CONCLUSION: The findings suggest several individual, psychosocial, and organisational risk factors for the adverse psychological outcomes observed in healthcare professionals during the COVID-19 pandemic. RELEVANCE TO CLINICAL PRACTICE: This study highlights the urgent need for screening for anxiety and depression and psychological interventions to combat an imminent mental health crisis in healthcare professionals during the COVID-19 pandemic. Pandemic response protocols and public health initiatives aiming to improve and prevent mental health problems in healthcare professionals during the current and future health crises, need to account for the various factors at play.

Efficacy of interventions to increase physical activity for people with heart failure: a meta-analysis.

OBJECTIVES: This meta-analysis aims to (1) evaluate the efficacy of physical activity interventions in heart failure and (2) to identify intervention characteristics significantly associated with the interventions' efficacy. METHODS: Randomised controlled trials reporting intervention effects on physical activity in heart failure were combined in a meta-analysis using a random-effect model. Exploratory meta-analysis was performed by specifying the general approach (eg, cardiac rehabilitation), strategies used (eg, action planning), setting (eg, centre based), mode of delivery (eg, face to face or online), facilitator (eg, nurse), contact time and behavioural change theory use as predictors in the random-effect model. RESULTS: Interventions (n=21) had a significant overall effect (SMD=0.54, 95% CI (0.13 to 0.95), p<0.0005). Combining an exercise programme with behavioural change intervention was found efficacious (SMD=1.26, 95% CI (0.26 to 2.26), p<0.05). Centre-based (SMD=0.98, 95% CI (0.35 to 1.62), and group-based (SMD=0.89, 95% CI (0.29 to 1.50),) delivery by a physiotherapist (SMD=0.84, 95% CI (0.03 to 1.65),) were significantly associated with efficacy. The following strategies were identified efficacious: prompts/cues (SMD=3.29, 95% CI (1.97 to 4.62)), credible source (standardised mean difference, SMD=2.08, 95% CI (0.95;3.22)), adding objects to the environment (SMD=1.47, 95% CI (0.41 to 2.53)), generalisation of the target behaviour SMD=1.32, 95% CI (0.22 to 2.41)), monitoring of behaviour by others without feedback (SMD=1.02, 95% CI (0.05 to 1.98)), self-monitoring of outcome(s) of behaviour (SMD=0.79, 95% CI (0.06 to 1.52), graded tasks (SMD=0.73, 95% CI (0.22 to 1.24)), behavioural practice/rehearsal (SMD=0.72, 95% CI (0.26 to 1.18)), action planning (SMD=0.62, 95% CI (0.03 to 1.21)) and goal setting (behaviour) (SMD=0.56, 95% CI (0.03 to 1.08)). CONCLUSION: The meta-analysis suggests intervention characteristics that may be suitable for promoting physical activity in heart failure. There is moderate evidence in support of an exercise programme combined with a behavioural change intervention delivered by a physiotherapist in a group-based and centre-based settings. PROSPERO REGISTERATION: CRD42015015280.

Cognitive dysfunction in adult CHD with different structural complexity.

OBJECTIVE: We carried out a cross-sectional study to assess cognitive function in a sample of adult CHD patients, within the Functioning in Adult Congenital Heart Disease study London. The association between cognitive functioning and disease complexity was examined. METHODS: A total of 310 patients participated in this study. Patients were classified into four structural complexity groups - tetralogy of Fallot, transposition of the great arteries, single ventricle, and simple conditions. Each patient underwent neuropsychological assessment to evaluate cognitive function, including memory and executive function, and completed questionnaires to assess depression and anxiety. RESULTS: Among all, 41% of the sample showed impaired performance (>1.5 SD below the normative mean) on at least three tests of cognitive function compared with established normative data. This was higher than the 8% that was expected in a normal population. The sample exhibited significant deficits in divided attention, motor function, and executive functioning. There was a significant group difference in divided attention (F=5.01, p=0.002) and the mean total composite score (F=5.19, p=0.002) between different structural complexity groups, with the simple group displaying better cognitive function. CONCLUSION: The results indicate that many adult CHD patients display impaired cognitive function relative to a healthy population, which differs in relation to disease complexity. These findings may have implications for clinical decision making in this group of patients during childhood. Possible mechanisms underlying these deficits and how they may be reduced or prevented are discussed; however, further work is needed to draw conclusive judgements.

Quality of life of adult congenital heart disease patients: a systematic review of the literature.

AIMS: This review explores the quality of life of adult congenital heart disease patients and the relationship between disease severity and quality of life. METHODS: We searched seven electronic databases and the bibliography of articles. The 31 selected studies fulfilled the following criteria: adult population; quantitative; assessment of quality of life and/or impact of disease severity on quality of life using validated measures; English language. Data extraction forms were used to summarise the results. RESULTS: There are evident methodological limitations within the reviewed studies such as heterogeneous populations, designs, and quality of life conceptualisations and measurements. Despite these problems, findings suggest that the quality of life of adult congenital heart disease patients is compromised in the physical domain compared with their healthy counterparts, whereas no differences were found in relation to the psychosocial and environmental/occupational domain. Some severity variables appear to be significant correlates of quality of life and could be considered in a future standardised classification of disease severity. CONCLUSION: The methodological limitations of past research in relation to the definition and measurement of quality of life, the study designs, and disease severity classifications need to be addressed in future studies in order to provide robust evidence and valid conclusions in this area of study. This will enable the development of targeted interventions for the improvement of quality of life in the adult population of congenital heart disease patients.